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Abstract 
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1 Introduction 


This paper, a companion to [7], develops tools to get useful quantitative bounds on rates of conver¬ 
gence to quasi-stationarity for absorbing Markov processes. With notation explained below, the 
bounds in [7j are of the form 


<P A 

2y\ 


#0 Pt - rj 


tv p A 


Mo Pt ~ rj 


tv 


In the middle is the term of interest: pt is the transition probability conditioned on non-absorbtion 
at time t ^ 0 and v is the quasi-stationary distribution. On both sides, Pt is the Doob trans¬ 
form (forced to be non-absorbing), Jj,q is an associated starting distribution and rj is the stationary 
distribution of the transformed process. The point is that quantitative rates of convergence to 
quasi-stationarity are hard to come by, requiring new tools which are not readily available. The 
pair (Pf , rj) is a usual ergodic Markov chain with many techniques available. 

The two sides differ by a factor p A /2p y . Here (p is the usual Peron-Forbenius eigenfunction for the 
matrix restricted to the non-absorbing sites and p A := min p. p v := max p. For the bounds to be 
useful, we must get control of this ratio. In [?], this control was achieved in special examples where 
analytic expressions are available with explicit diagonalization. The purpose of the present paper is 
to give a probabilistic interpretation of this ratio as well as several bounding techniques. For back¬ 
ground on quasi-stationarity see Meleard and Villemonais M, Collet, Martinez and San Martin 
[5], van Doom and Pollett [22], Champagnat and Villemonais [3] or the discussion in [7j. We 
proceed to a more careful description. 

Let us begin by introducing the finite setting. The whole finite state space is S := S u {oo}, 
where co is the absorbing point. This means that S is endowed with a Markov generator matrix 
L := (L(x,y )) Xty whose restriction to S x S is irreducible and such that 

V x e S, L(oo,x) = 0 

3 x £ S : L(x, oo) > 0. 


Recall that a Markov (respectively subMarkovian) generator is a matrix whose off-diagonal entries 
are non-negative and such that the sums of the entries of a row all vanish (resp. are non-positive). 

An eigenvalue A of L is said to be of Dirichlet type if an associated eigenvector vanishes at oo. 
Equivalently, A is an eigenvalue of the S x S minor K of L. Since the matrix K is an irreducible 
subMarkovian generator, the Perron-Frobenius theorem implies that I\ admits a unique eigenvalue 
Ao whose associated eigenvector is positive. The eigenvalue Ao is simple and we denote by p an 
associated positive eigenvector. Its renormalization is not very important for us, because we will 
be mainly concerned by its amplitude defined by 


with 

p v := rnaxw(x), p A := minw(x). 
xeS xeS 

We refer to [7j for the importance of a v in the investigation of the convergence to quasi- 
stationarity of the absorbing Markov processes generated by L. Our purpose here is to estimate 
this quantity. 

Our approach is based on a probabilistic interpretation of ip and, more precisely, of the ratios 
of its values. For any x e S, let X x := o be a cadlag Markov process generated by L and 

starting from x. For any y e S, denote by t x the first hitting time of y by X x : 

Ty ■= inf{t 0 : Xf = y}, (1) 
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with the convention that t x = +oo if X x never reaches y. The first identity below comes from 
Jacka and Roberts [Ill- 

Proposition 1 For any x, y e S, we have 

—|-y = E [exp (A 0 Ty )\ T x <T x ]. 

In particular, with O := {x e S : L(x, oo) > 0} ; we have 

<V = _ n d a ^ E [ ex P( A o'^)lr-<rs]- 


xeS, yeO 


This probabilistic interpretation leads to two methods of estimating a^. The first one is through 
a path argument. 

If 7 = ( 70 , 71 , ..., 71 ) is a path in S, with T(jk,7k+i) > 0 for all k e [0, l — 1], denote 


7 ) := 0 


L{lk,lk+\) 
|Z(7fc,7fc)| - A o 


( 2 ) 


fcepM-lJ 

(for any V ^ l" e Z, [/', l"j := {/', l' + 1, I" - 1, l"} and for l' e N, [/'] := [1, l'j). 


Proposition 2 Assume that for any y 6 O and x e S, we are given a path 'y VtX going from y to x. 
Then we have 




min P(nty,x) 
yeO,xeS 


The second method requires that K (the generator restricted to S) admit a reversible probability 
7 / on S, namely satisfying 


Vx,yeS, r](x)L(x,y) = r)(y)L(y,x). 


The operator —K is then diagonalizable. Let Ao < Ai ^ A 2 < ■ ■ • ^ Aat_i be its eigenvalues, where 
N is the cardinality of S (the first inequality is strict, due to the Perron Frobenius theorem and to 
the irreducibility of K). For any x e S, let Ao(5'\{x}) be the first eigenvalue of the (5\{x}) x (5\{a;}) 
minor of —K (or of —L). Finally, consider 

Aq := min A 0 (5'\{x}). (3) 


Proposition 3 Under the reversibility assumption, we have 



One advantage of the last result is that it can be extended to absorbing processes on denumer¬ 
able state spaces, at least under appropriate assumptions. We won’t develop a whole theory here, 
so let us just give the example of birth and death processes on Z + absorbing at 0 and for which 
00 is an entrance boundary. To follow the usual terminology in this domain, we change the nota¬ 
tion, 0 being the absorbing point and 00 being the boundary point at infinity of Z+. We consider 
S := N := {1,2,3,...} and S := Z + := {0,1, 2,3,...}, endowed with a birth and death generator Z, 
namely of the form 


Vx + yeS 1 , L(x,y) 


b x , if y = x + 1 

d x , if y = x - 1 

-d x -b x , if y = x 

, 0 , otherwise, 
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where (b x ) x ei + and (d x ) xe n are the positive birth and death rates, except that bo = 0: 0 is the 
absorbing state and the restriction of L to N is irreducible. 

The boundary point oo is said to be an entrance boundary for L (cf. for instance Section 8.1 of 
the book [2] of Anderson) if the following conditions are met: 


where 


E 


7T rf 


■S' 

y=l 


s 


1 

ftx 


00 


S n v 

y=x +1 


= +00 


< + 00 , 


V x e N, 



1 

bil>2 

dids-dx 


, if x = 1 
, if x ^ 2. 


(4) 

(5) 

( 6 ) 


The meaning of Q is that it is not possible (a.s.) for the underlying process X x , for x e Z + to 
explode to oo in finite time, while © says it can come back in finite time from as close as wanted 
to oo. 

One consequence of fl5J) is that Z := XixsN 71 x < +°°> so we can cons ider the probability 

V x e N, rj(x) := Z -1 7r x . 


Denote by T the space of functions which vanish outside a finite subset of points from N and 
by K the restriction of the operator L to T. It is immediate to check that K is symmetric on 
L 2 (r/). Thus we can consider its Freidrich’s extension (see e.g. the book of Akhiezer and Glazman 
HI), still denoted K, which is a self-adjoint operator in h 2 (r]). The fact that co is an entrance 
boundary ensures indeed that such a self-adjoint extension is unique. It is furthermore known that 
the spectrum of —K only consists of eigenvalues of multiplicity one, say the (A n )neZ + i n increasing 
order, see for instance Gong, Mao and Zhang CQJ. Let ip be an eigenvector associated to the 
eigenvalue Ao > 0 of —K. As in Q, since the absorbing point is only reachable from 1, we also 
introduce 


Aq := A 0 (N\{1}), 


which is the first eigenvalue of the restriction of — K to functions which vanish at 1. 
We can now state the extension of Proposition [3j 

Theorem 4 Under the above assumptions, we have \' 0 > Ao and 

2 T < +c0 . 


TIE Z+ 


In particular, we deduce that 


1 - n (1 

A o/ neN 


Aq 

An 


> 0. 


(7) 


Up to a change of sign, the eigenvector p> is increasing on Z + (with the convention <p(0) = 0 ). It 
is furthermore bounded and its amplitude satisfies: 


suPgeN ^( x ’) _ limg-oo <p(x) 

infyeN tp{y) ¥>(1) 
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There is a classical converse result, showing that the criterion of entrance boundary is in some 
sense optimal for effective absorption at 0 and boundedness of ip. It is typically based on the 
Lyapounov function approach of convergence of Markov processes (cf. the book of Meyn and 
Tweedie [15j). Proposition [5] below gives a more precise statement for an example. 

Let L be a birth and death generator on Z+, absorbing at 0 and irreducible on N. It is always 
possible to associate to it the minimal Markov processes X x := (X t )o<ct <(Too , starting from x e Z + 
and defined up to the explosion time cr^. These are constructed in the following probabilistic way, 
where all the used random variables are independent (conditionally to the parameters entering in 
the definition of their laws). We take Xf = x for 0 ^ t < cy, where a\ is distributed according to 
an exponential variable of parameter |L(x, x)| (if x = 0, L(0, 0) = 0, so o\ = +oo = a x , namely the 
trajectory stays at the absorbing point 0). Next, if x =)= 0, the position X® = y is chosen according 
to the distribution (L(x,y)/\L(x,x)\) ye §\f x y The process stays at this position for t e [0i,< 72), 
where (J 2 o\ + £ 2 , with £2 an exponential variable of parameter L(X® x , X^) . If X X _ L 4= 0, the 
next position X x 2 = y is chosen according to the distribution (L(X x 1 ,y)/\L(X x 1 ,X x 1 )\) ye gu x ^ }• 
This procedure goes on up to the time a& := lim n _ >+00 a n (by convention a 00 = +co if one of the 
a n , n e N, is infinite, which a.s. means that 0 has been reached). 

We consider again the first hitting times t x defined in (fTj) , now for x,y e Z+. 

Proposition 5 Assume on one hand, that there exist x e N such that Tq is a.s. finite, namely 
the process X x a.s. ends up being absorbed at 0. Then this is true for all x e Z+. On the other 
hand, that there exist a positive number A > 0 and a positive function (p on N, with finite amplitude 
a<p < +co, which satisfy K[ip] ^ —A ip. Then co is an entrance boundary for L. 

Condition (JSJ) (coming back from infinity in finite time) for birth and death processes satisfying 
® (non explosion) and admitting a positive generalized eigenvector (i.e. not necessarily belonging 
to 1 L 2 (77)) associated to a positive eigenvalue of —K is also known to be equivalent to the uniqueness 
of the quasi-invariant probability distribution, see Theorem 3.2 of Van Doom m (or Theorem 5.4 
of the book [5] of Collet, Martinez and San Martin). Thus the quantitative reduction (through 
the amplitude a v ) of convergence to quasi-stationarity to the convergence to equilibrium presented 
in [7] can be applied to such birth and death processes, if and only if they admit a unique quasi¬ 
invariant distribution. 

The uniqueness of the quasi-stationary probability was characterized in a general setting by 
Champagnat and Villemonais j3]. It appears that may be infinite in this situation, in particular 
if diffusion processes are considered (then inf (p = 0). 

The paper is constructed according to the following plan. In the next section, Proposition 
[1] is recovered along with a probabilistic interpretation of the first Dirichlet eigenvector ip. As 
a consequence, Propositions [2] and [3] are obtained in Section [3j The situation of denumerable 
absorbing at 0 birth and death processes is treated in Section 01 where an example is given. 

2 Probabilistic interpretation of ip 

Our main purpose here is to recover the stochastic representation of the ratio of the first Dirichlet 
eigenvector ip given in Proposition |T] This is due to Jacka and Roberts [IT] , who deduce it 
from the corresponding discrete time result proven by Seneta m- Since these authors work with 
denumerable state spaces, for the sake of simplicity and completeness, we present here a direct 
proof for finite state spaces. 

We start by recalling three simple and classical results. Consider V(S) the set of probability 
measures on S. Generalizing (JTJ), let us define, for any initial distribution y e V(S) and for any 
yes, 

Ty ■= inf {t > 0 : Xf = y}, 
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where (X^)t^o is a cadlag Markov process generated by L and starting from fi. 
Lemma 6 For any A 17 0 , we have 

3 fie V(S) : E[exp(Ar^)] < +oo <=> V fi e V(S), E[exp(Ar^)] < +oo. 


Proof 

It is sufficient to consider the direct implication, the reverse one being obvious. Since for any 
/j 6 V(S), we have 

E[exp(Ar£,)] = ^ ^(x)E[exp(Ar*)], 

xeS 


we just need to check that 

V x, ye S, 


namely 


E[exp(Ar^,)] < +oo E[exp(Ar^,)] < +oo, 


V x,y e S, E[exp(Ar^ ) )] < +oo => E[exp(Ar^,)] < +oo. (8) 

For given x,y e S, let 7 = ( 70 , 71 , 7 z) be a path in S going from x to y and satisfying 
Z( 7 ^, 7 ^+ 1 ) > 0. Such a path exists, by irreducibility of K. Let A 7 be the event that the first jump 
of the trajectory X x is from x = 70 to 71 , that the second jump of X x is from 71 to 72 , ..., that 
the l -th jump of X x is from 7 ;_i to 77 By the probabilistic construction of X x , we have that 


P[A 7 ] 


£(70,7i) ^(71.72) 

l^(7o,7o)| |^(7i,7i)l 
> 0 . 


|L(7;_i,7i_i)| 


(9) 


Using the strong Markov property of X x at the minimum time between the time of the l -th jump 
time and the absorbing time, we get 


which implies (f5j). 


E[exp(Ar£)] 


^ E[1 A7 exp(Ar^)] 

> E[l A 7 E[exp(Ar^)]] 
= P[ J 4 7 ]E[exp(Ar| ) )], 


Define 


A := {A ^ 0 : V fi e V(S), E[exp(Ar^)] < + 00 }. 


Lemma 7 We have 


A = [0, A 0 ). 


Proof 

Consider u e V(S) the quasi-stationary distribution associated to Z, namely the left eigenvector of 
K (extended to vanish at 00 ) associated to the eigenvalue —Ao- For any t 17 0, the distribution of 
X" is exp(—Aot)^ + (1 — exp(—Aot))5oo. It follows that 

0, P[t£, > t] = P [X?eS] 

= exp(-A 0 t), 
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namely, t£, is distributed according to the exponential law of parameter Aq- In particular, we have 


V A ^ 0, E[exp(Ar£)] = 


UfA< 
+oo , if A + 


The announced result follows from the previous lemma, showing that 

A := {A ^ 0 : E[exp(Ar£,)] < +oo}. 


Ao 

Aq. 


For any A e A, we can consider the mapping <px defined on S by 


V x e S, tp\(x) 


E[exp(Arg,)] 

E[exp(Ar&)j ’ 


where v e V(S) is the quasi-stationary distribution of L, whose definition was recalled in the above 
proof (but for our purpose, v could be replaced by any other fixed distribution of V(S)). 


Proposition 8 As A e A converges to Ao, the mapping ip\ converges on S to a function ip which 
is a positive eigenvector associated to the eigenvalue Aq of —K. 


Proof 

We begin by checking that for fixed A e A, ip\ satisfies 

V xeS, L[ip x ](x) = -\<px(x). (10) 

To simplify the notation, define 

Vie S, ipx(x) ■= E[exp(Ar£,)], (11) 

it is sufficient to show that L[ifx] = —A^>a on S. This comes from the fact that for x e S, the 
quantity ifx(x) can be seen as the Feynman-Kac integral with respect to the Markov process X x 
and the potential Alg. But maybe the shortest way to deduce it is to use the martingale problem 
associated to X x (for a general reference, see the book of Ethier and Kurtz [8]). More precisely, 
consider the mapping / on M + x S defined by 

V (t, y) e M+ x S, f(t,y) := exp(\t)ifx(y)- 


There exists a local martingale M = (Mt)t ^o such that a.s. 


Vt^O, f(t,Xf) 



d s f(s , Xf) + L[f(s , ■)](*?) ds + M t . 


The fact that A e A implies that M is an actual martingale (namely that for all t ^ 0, Mt is 
integrable). In particular, by the stopping theorem, we get that for any t ^ 0, E [M tAT ^\ = 0, so 
that 


E[f(tAT^,Xf AT ,)] = ifx{ x ) + E 


rtA-r£ 

Jo 


d s f(s,Xf) + L[f(s,-)](Xf)ds 


But the strong Markov property applied to the stopping time t a implies that 


E [f(t A t£, X? ATS 


)] = 


7 


E[exp(Ar£)] 

'f’x(x), 






and we get that 


E 


f ArC ° d s f(s, Xf) + L[f(s, •)](**) ds 

Jo 


0 . 


Taking into account that for any s ^ 0 and ?/eS, d s f(s,y ) = A f(s,y), we deduce that 


A^a(x) + L[ip x ](x) 


lim t X E 
t-^o+ 

0 , 


r TC °\f(s,X*) + L[f(s,-)](X*)ds 

Jo 


which amounts to (1101) . 

Of course, the A e A are not Dirichlet eigenvalues of L , because =1= 0: 

¥>a(°°) = - tt vV , , 

E|exp(Ar£,)J 

but as A e A goes to Ao, this expression converges to zero. Furthermore, if for x,y e S, we call r xy 
the r.h.s. of Q and 


r = min r r ,,, 
x,yeS x,y ’ 

then 

VAeA, Vs, ye 5, r ^ ^ r -1 . (12) 

JxJ) 

Thus we can find a sequence ( l n )neN of elements of A converging to Ao such that (fi n converges 
toward a function 93 on S, positive on S. According to the previous observation 93 ( 00 ) = 0 and 
taking the limit in (flOl) . we get 


L[tp\ = -A 0 93 , 

it follows that the restriction to 5 of 93 is a positive eigenvector associated to the eigenvalue Ao of 
—K. Furthermore, 


v[<p] = I™ uM = 

A—>Ao — 

and this normalization entirely determines 93 . It follows that the mapping 93 does not depend on 
the chosen sequence ( l n )neN ■ A usual compactness argument based on (fl2l) shows that in fact 

lim 93 a = <p. 

A—»Aq — 


We need a last preliminary result. 
Lemma 9 For any x e S, we have 


A 0 (S\{*}) > A 0 , 


where we recall that the l.h.s. is the first eigenvalue of the {S\{x}) x (S\{x}) minor of —L. 








Heuristically, this result says that for any fixed x e S, it is asymptotically strictly easier for the 
underlying processes to exit jS\{x} than S. It is well-known in the reversible context, via the 
variational characterization of the eigenvalues, but we cannot use that argument here. Note also 
that in the trivial case where S is reduced to a singleton, by convention Ao(0) = 4-oo and the 
above inequality is also true. 

Proof 

Fix x £ S and let ip x be a positive eigenvector associated to the eigenvalue — Ao(5'\{x}) of the 
(S\{x}) x ( S\{x }) minor of —Z. Extending <p x on S by making it vanish on {oo,x}, we have that 

VyeS\{x}, L[ip x ](y) = -A 0 (S\{x})<p x (y). 


Consider the set 


S' := {y e S : <p x (y) = 0} 3 {x}. 

By irreducibility of K, there exists xq e S' and yo £ S\S' with Z(xo,yo) > 0. It follows that 

LVp x ]{x o ) = 

ye S 

= 

yeS 

> L(xo,yo)v x (yo) 

> 0 . 


Similarly, we prove that 

\/yeS', L[v x ]{y) > 0 

(this is the maximum principle for the Markovian generator L). 

Let v be the quasi-stationary measure associated to Z, already encountered in the proof of 
Lemma [TJ Since vL = — Ao^, we have in particular 

v[L[v x }\ = -Ao^*]. 

But according to the previous observations, we have 

v[L[ip x ]\ = v[ts\ S ,L[<p x ]] + is[t s >L[(p x ]\ 

= -A 0 (5\{x})^[l S \ S /<y9 X ] + v[t S'L[<p X ]] 

= -\ 0 (S\{x}Mv x ] + v[t S 'L[<p x ]] 

> -Ao(5\{x})^[^]. 

It follows that 

A 0 (5\{x}) > A 0 . 


We can now come to the 

Proof of Proposition |Tj 

Concerning the first equality, let us fix x, y e S. We can assume that x =|= y, since the equality is 
trivial for x = y. According to Proposition [HI it is sufficient to see that 

JSS_£g = E [ eX P( A 0^) 1 ^<r S ]- (13) 
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Define t = tJ a t^. It is the exit time from S\{y} for X x . In particular, we have 

V l e R+, E[exp(7r)] < +oo l < Ao (S\{y}), 
and Lemma [9] implies that 

E[exp(Aor)] < +oo (14) 

For A 6 A, consider again the function defined in dill) . Using the strong Markov property at 
time r, we have 

ipx(v) = E[exp(Ar)lx ? = y V , A(y)]+E[exp(Ar)lx ? =ooV ; A( 0 o)] 

= V’A(y)E[exp(Ar)lx-=; / ] + E[exp(Ar)l X x =00 ] 

Dividing by ip\(y), taking into account (ThD) and letting A go to Ao, we get (fl3l) . In particular, we 
deduce that 


a v = max E[exp(Ao^)l r «< T j] 


To show the representation of a v in Proposition |T] it is enough to check that = min^o tp(y). 
This is a consequence of the fact that for any y e 5, either y e O or there exists a neighbor z e S 
of y (namely a point satisfying L(y,z) > 0) with tp(z) < ip(y). Indeed this comes from 


2 - ip(y)) = -A 0 ip(y) 


3 Path and spectral arguments 


It will be seen here how the probabilistic representation of the amplitude a v can be used to deduce 
more practical estimates. 

We begin with a path argument, similar in spirit to the one already encountered in the proof 
of Lemma |6l Let 7 = ( 70 , 71 , ■■■ill) be a path in S, to which we associate the event A 7 requiring 
that the first jump of the trajectory X 70 is from 70 to 71 , that the second jump of A ' 70 is from 71 
to 72 , ..., that the Ltli jump of A 70 is from 7 ;_i to 7 ;. 


Lemma 10 For any A e [0, min(|L( 7 fc, 7 *,) 


k e | 0 , l — 1 ])), we have 


E[1at exp (At 70 )] 


n 

fce[0,Z—1] 


L{lkilk+i) 

L{lk,lk)\ - A' 


If A ^ min(|L( 7 fc, 7 ^)] : k e [0, l — 1]), the expectation in the l.h.s. is infinite. 


Proof 

This result is directly based on the probabilistic construction of the trajectory A 70 . Let us recall 
it: A 70 stays at 70 for an exponential time of parameter |-^( 7 o, 7 o) |, then it chooses a new posi¬ 
tion x\ according to the probability L( 7 o, x\)/ |L( 7 o, 70 ) • Next it stays at x\ for an exponential 
time of parameter |Z(xi,xi)|, until it chooses a new position x 2 with respect to the probability 
L(xi, X 2 )/\L{xh xi)|, etc. To simplify the notation, denote 

V fee [0,Z — 1], L k := |Z(7fe,7fe)|- 
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It follows that if A < min(Lfc : k e [0, l — 1]), 
E[ 1 U 7 exp(Ar^ 0 )] 

Hlkilk+i) 


n 


l/cg[ 0 ,/— 1 ] 


Lk 


III eA( ‘” +,,+ ' + " ) L ^ dt ° L « L '" ih - ■ ■ 


n ( L(7t ^ W h t J eWW itk 


fcG[0,Z —1] 


n 


fce[0,(—1] 


L{lk,lk+l) 
Lk — A 


The same computation shows that if for some k e [0, Z —1], A ^ |T( 7 fc, 7 fc)|, then Efl^-y exp(Ar^ 0 )] = 
+oo. 


Proof of Proposition [2] 

It is now a consequence of the following observation: if is a path going from y to x in S, then 
from Proposition |1] we get 


<p(y) 

<P(x) 


= E[exp(A 0 r|)l r a <T a ] 

^ EpUr exp(A 0 rf)] 

= ^( 7 y,x)i 


according to the previous lemma (where the functional P was defined in (J2J)). Indeed, one would 
have noticed that 


Ao ^ min |L(x, x) 
xeS 


Arguments similar to those given in the proof of Lemma [9] (reinterpret L(x, x) as the first Dirichlet 
eigenvalue associated to the {x} x {x} minor of L) show that the above inequality is strict, except 
if S is a singleton. In the latter case, say S = {xo}, necessarily y = x = x o and 7 ^ XQ = (xo), so 
that the product defining P^xq^o) is void, meaning that P('y xo ,xo) = 1, as it should be. 

Coming back to the general case and taking the minimum over x e S and y e O, we get 


as announced. 






<p(y) X 

yeO, xeS (f(x) ) 


mm 


min P(rr v ,x) 

yeO,xeS 


One can deduce a rougher estimate, where Aq does not enter: with the notation of (J2J), define 


then we have 


<3(7) 


n 

fce[0,Z-lI 


|^(7fc,7fc)| 
^(7fc;7fc+i) ’ 




< 


max 
yeO , xeS 


Q{ly,x)- 


(15) 
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Let us illustrate these computations with 

Example 11 (a) Consider an oriented finite strongly connected graph G on the vertex set S and 
denote by E the set of its oriented edges. Let O be a non-empty subset of S. Let G be the oriented 
graph on S = S u { 00 } obtained by adding to E the edges (x,oo), with x e O. Let d be the 
maximum outgoing degree of G and D be the “oriented diameter” of G. Let L be the random 
walk generator associated to G: 


Vx + 7 /eS’, L(x, y) 


1 , if (x,y) e E 
0 , otherwise. 


Choosing geodesics (with respect to the “oriented graph distance”) for the underlying paths, the 
bound (fl5l) implies that 


< d D . 


There is an easy comparison allowing weighted edges in the case above. If the generator L is 
perturbed to another generator L only satisfying, for some constants 0 < r < R < +co, 


we end up with 


Vx^yeS, L(x,y) e 


[r, R] , if (x, y) e E 
{0} , otherwise, 





(16) 


(b) To see if this bound is of the right order, let us consider a specific birth and death examples 
on S = [0,1V], with Ns N, absorbed in 0 (namely 00 in the previous notation). The only non-zero 
jump rates of L are given by 


V x e [1, IV — 2], 
Z(1,0) = 1 , L{N 


j L(x, x + 1) := p 

( L(x + 1, x) := 1 

1, N) = p and L(N,N- 1) 


1 + Pi 


for some fixed p > 0. The bound (fTBl) leads to 


It was seen in [7] that 






^(1 + 0{N~ 2 )) , if p = 1 

^t(! + o(p- N )) , if p > 1, 


(17) 

(18) 


(19) 


( 20 ) 


but it can be deduced from the computations presented in Section 3.3 of [7] that if p < 1 is fixed, 
then dp explodes exponentially with respect to N. So (fl9l) corresponds to the right behavior of 
(i.e. it does explode exponentially with respect to N ) if and only if p < 1. 

□ 

In the previous example for p ^ 1, the path estimate does not catch the fact that either is 
bounded (for p > 1) or explodes linearly with respect to N (for p = 1). The spectral estimates 
we are about to present are more precise and we will see how to recover these behaviors of a^ for 
p ^ 1 and large N. 

We begin with a general result which can be deduced from Miclo M- 


12 



Lemma 12 In the finite setting and under the reversibility assumption, whatever // e 'P(S), the 
time T& is stochastically dominated by the sum of independent exponential variables of respective 
parameters Ao, Ai, Xn-i, where N is the cardinality of S. 

Proof 

Indeed, for any k e JO, N — 1 ], denote by Ch the convolution of k + 1 exponential laws of parameters 
Xn, Ajv-i, • A N-k- It was seen in m that the law of is a mixture of the £&, for k e [0, N — 1], 
the coefficients of the mixture depending on y (and the coefficient of C-n -i being positive). The 
announced result follows from the fact that each of the laws for k e [[0, N — 2], is clearly 
stochastically dominated by Cn-i- 

U 

We can now come to the 

Proof of Proposition [3] 

Note that 


a v = 1 v max E[exp(A 0 r*)l r ®< r *], 

xeS,yEO,y=\=x y 


thus it is sufficient to show that 


max E[exp(A 0 r^)l 
xe S,yeO,y=\=x 


y ' T y <T oo 


] < 


1 - 


Ao 


A; 


n 


0/ fce[iV-l] 


1 - 



Fix y e O, let K be the ( S\{y }) x (S\{y }) minor of L and denote Ao < Ai ^ ^ Aat -2 the 

eigenvalues of —K. By the usual interlacing property of the eigenvalues of minors, we have 


Ao < Aq ^ Ai ^ Ai ^ A2 ^ ^ Atv—2 ^ Atv—2 ^ Ajv-i- 


( 21 ) 


The hrst inequality is strict, due to Lemma [9l According to the previous lemma, we have that 
for any x e S\{y}, Ty a is stochastically dominated by the sum of independent exponential 
variables of respective parameters Ao, Ai, ..., Atv- 2 - It follows that 


E[exp(A 0 T*)l r *< r *] s; E[exp(A 0 (r* a t*))] 

< E[exp(A 0 (£’o H-b S N - 2 ))\, 

where £0, ..., £n -2 are independent exponential variables of respective parameters Ao, Ai, ..., Atv- 2 - 
Thus the last expectation is also equal to 

n E [exp(A 0 ^)] = n ( 22 ) 

Zg[0,JV-2] Zg[0,JV-2] * l Ao 



where the interlacing (12111 was used, as well as the definition of Aq given in ([3]). Proposition [3] 
follows, since the above upper bound no longer depends on the choice of y e O. 
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Let us now show how the spectral estimate can provide a better bound than the path estimate, 
at least when some knowledge on the relevant eigenvalues is available. 

Example 13 We return to the birth and death processes presented at the end of Example [TT] 
with p ^ 1. 

We first treat the case p = 1, for which we have seen in |7j that the eigenvalues of —K are given 
by 


V ke [0,JV-lJ, A fc = 2(1 — cos((2/c + 1)tt/(2N))). 


With the notation of the proof of Proposition O we have O = {1} and the matrix K is the same 
as K , except that N has been replaced by N — 1. Thus we get that 

V ke [0,1V-2], Afc = 2(1 - cos((21fc + 1 )tt/(2(JV - 1)))). 

By using (l22l) directly, we get the bound 




n 

Ze[0,iV—2] A; A 0 


n 

Ze[0,7V-2] 


M 

Az ) 


and the first bound is in fact an equality, because it is known that the time needed by a finite birth 
and death process to go from one boundary point to the other one is exactly a sum of independent 
exponential variables whose parameters are the corresponding Dirichlet eigenvalues (see e.g. Fill 
[9] or Diaconis and Miclo [6] for a probabilistic proof as well as a review of the history of this 
property). In the above product, we begin by considering the first factor 

Ao = sin 2 (7r/(4iV)) 

A 0 sin 2 (7r/(4(IV - 1))) 

sin 2 (7r/(4(IV — 1))) — sin 2 (7r/(4iV)) 
sin 2 (7r/(4(IV — 1))) 

sin(7r/(4IV(jV - 1))) sin(7r(2IV - 1)/(4IV(IV - 1))) 
sin 2 (7r/(4(A r — 1))) 


where we used the trigonometric formula 


V o, b e R, sin 2 (a) — sin 2 (6) = sin(a + b ) sin(a — b). 

Letting N go to infinity, it appears that 

Ao 


1 - 


Ao 


N 

T’ 


(23) 


which provides us with the announced linear explosion in N. It remains to treat the other factors 

Ao i sin 2 (7r/(4IV)) 


1 - 


= 1 - 


A k sin 2 ((2fc + l)vr/(4(IV - 1)))’ 

for fee [1 ,N — 2], Taking into account that 


sin 2 (7r/(4A r )) 1 

ZV->oo sin 2 (37r/(4(IV — 1))) 9’ 


lim 
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and that for all 9 e [0, vr/2], 29 jix ^ sin(0) ^ 9, we can find a constant c > 0 such that for N large 
enough, 


V k e [1, iV — 2], 


sin 2 (7r/(4A r )) 


sin 2 ((2/c + l)7r/(4(A r — 1))) 


sS - a 


8 (2k + l) 5 


This bound and the dominated convergence theorem show 

sin 2 (7r/(4iV)) 


lim 

TV—>oo . 




sin 2 ((2fc + l)7r/(4(iV — 1))) 


2 inf 1 


fce[l,TV—2] v vv ) \ III' fcsN 

The above observations and (1201) lead in fact to Wallis’ formula: 


(2fc + l) 2 


n 


/cgN\{1} : k even 


i-i . i 

k 2 4 


> —oo. 


We now come to the case p > 1. As remarked above, for all finite birth and death processes 
absorbed at 0, we have an exact formula 


°V — 0 

Ze[0,iV—2] 


1 - 


Ao 

A; 


-l 


but to exploit it, one needs a knowledge of the eigenvalues Ao, Ao, Ai, ..., Xn- 2 - The only behavior 
provided in [7], is that for large N 

Ao ~ \(p + l)(p-l) 2 -^. (24) 

z p 


Let us show how this is sufficient to deduce that a^ remains bounded as N go to infinity. In¬ 
deed, we will just need an additional qualitative result about the number of nodal domains of the 
corresponding eigenvectors, which is a discrete analogue of Sturm’s theorem for one dimensional 
diffusions. 

We begin by treating the first factor. As above, by spatial homogeneity, Ao is just Ao when N 
has been replaced by N — 1. It follows that Aq ~ \(p + 1 )(p — l) 2 ^kr, so that 


lim 

JV—>oo 




which in comparison with (|23l) . is a first indication why a^ should stay bounded as N goes to 
infinity. 

It remains to prove that 


Since we know that 


lim sup 

TV—>oo 


Z ln 

Ze[1,7V—2] 



< + 00 . 


V Z e [1,1V - 2], 


Aq 
A i 


Aq 

Ao 


for N large enough, it is sufficient to find a constant c > 0 such that 

V Z e [1,1V - 2], ^ < cp-\ 

A i 
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or similarly, such that 


V Z e [1,AT — 1], 


Ao 

A i 


(25) 


cp 


For given l e [[1,1V — 1], let <pi be an eigenvector of — L associated to the eigenvalue A; and 
vanishing at 0. Since L is a tri-diagonal matrix, ipi has l + 1 nodal domains. More precisely, extend 
<pi into a continuous function on [0, N] by making it affine on each of the segments [n, n + 1] with 
n e [0, N — 1], Then ipi has exactly l + 1 zeros: xq = 0 < x\ < ■ ■ ■ < xi and it was seen in Miclo |T6] 
that if Xk £ [0, IV], there is a natural way to define the jump rates L(\xk],Xk) and L([xk J, Xfc) such 
we have 


V A; e [0, Z], A 0 ([® fe , x k +i]) = A i 

with the convention xi + \ = N. Since each of the segments [xfc,Xfc + i], for k e [0, Z], contains at 
least one integer, we have xi ^ Z and by consequence 

A, = Xo([x l: N]) 

> A 0 ([Z, N]). 

Due to the spacial homogeneity of the initial generator Z, Ao([Z,-ZV]) is the same as Ao where N is 
replaced by N — l. The bound (l25l) is now an easy consequence of (124]) . through the existence of a 
constant C ^ 1 (depending on p > 1) such that 

V N e N, C~ l p~ N ^ A 0 < Cp~ N . 


□ 


4 Some denumerable birth and death processes 

This section treats denumerable birth and death processes absorbing at 0 and with co as entrance 
boundary via approximation by finite absorbing birth and death processes. 

We begin by recalling the theory of approximation of birth and death processes with oo as 
entrance boundary, as developed by Gong, Mao and Zhang jTO ]. For N e N, consider the finite 
state spaces Sjy := [iV] and Sn [0, iV] endowed with the Markovian generator Ljy which is the 
restriction of L to Sn, except that Ln(N,N) = — 6/v_i, so that a Neumann (reflection) condition 
is put at N. The point 0 is still absorbing for Ln- Denote by 

Aat,o < Atv,i < A tv,2 < ■ ■ ■ < Atv,TV-1, 

the eigenvalues of the subMarkovian generator Kn, the restriction of Ln to Sn- By convention, 
take \n,u := +go for n ^ N. 

Theorem 5.4 of Gong, Mao and Zhang [TOj asserts that for any fixed n 6 Z+, the sequence 
(ATV,n)iVeN is non-increasing and that 


lim A a T, n = A n , (26) 

TV—>oo 

where (A n ) ns z + are the eigenvalues of —K defined in the introduction. 

For N e N\{2}, let X' N0 be the smallest eigenvalue of the restriction of Ln to |2,iV]]. Consider 
the absorbing Markov generator L' on N, coinciding with the restriction of L there, except that 1 
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is absorbing: 1/(1,1) = L'( 1, 2) = 0. Applying (|26l) with n = 0 and with respect to L', shows that 
the sequence (X' N 0 )jVeN\{i} is non-increasing and 

lim X' N0 = Aq. (27) 

TV—>oo 

These convergence properties are the main ingredient to deduce the estimate of Theorem 0] from 
Proposition [3l We will also need the fact that the eigenvector ip can be chosen to be positive on N 
and increasing. This is well-known, see for instance Chen [1] or Miclo m, whose arguments can 
be extended to the present denumerable absorbing birth and death setting. We present a succinct 
proof for the sake of completeness. 

For any function / defined on N, consider the value 

£(/) = f?(lK/ 2 (l) + rj{x)b x (f(x + 1) - f{x)) 2 e M+u {+oo}. 

X^l 


Then ip is a minimizer of £(f)/r](f 2 ) over all functions / e L 2 (r/)\{0}. 

Since £(f) ^ £(|/|) for any function /, we can assume that ip is non-negative, up to replacing 
it by \ip\. For fixed x e N, considering the quantity cp(x) as a variable in the ratio £{ip)/^(ip 2 ), it 
appears by minimization that <p(x) e [min(<^(x — 1 ),ip(x + l)),max(<^(x — 1 ),<p(x + 1))] and even 
<p(x) e (min((^(x — 1 ),cp(x + l)),ma x(cp(x — l),ip(x + 1))) if (p(x — 1) =(= + !)■ This property 

implies the monotonicity of ip. Since <^(0) = 0 and ip must be positive somewhere, it follows that 
ip is non-decreasing. Consider xq := max{x : <p(x) = 0}. From ip{x) e (0 ,ip(x + 1)), we end up 
with a contradiction if x =(= 0. So xo = 0 and ip is positive on N. The same argument shows that 
if there exists x £ N such that ip{x) = ip(x + 1) then <p(x — 1) = <p(x). By iteration it would imply 
that ip vanishes identically. Thus <p is increasing, not only non-decreasing. 

This observation is also valid for L there is an eigenvector ip' associated to the eigenvalue — Aq 
(of K'. the restriction to N\{1} of L') which is positive and increasing on N\{1}. Indeed, oo is also 
an entrance boundary for L' , so that its spectrum consists equally of eigenvalues of multiplicity 1, 
in particular ip' exists. As a consequence we get that Ag > Ao: 

Lemma 14 With the above notation, 


X 


/ 

o - 


Aq 


t/(1)6i 


vW<p\ 


> o 


(where ip' is seen as function defined on N with the convention ip'( 1) = 0). 


Proof 

The result follows from the computation of rj\ip'K [</?]]: by definition of <p, 

rj[ip'K[ip]\ = —Xoifiip'ip]. 

By self-adjointness of K the l.h.s. is equal to r)[ipK[ip']\. We remark that for x e N, 

K[ip'](x) = K'[ip'](x) + b 1 <p'(2)1 {1} (x) 

= -Aq ip'(x) + b 1 ip'(2)t {1} (x) 

(by convention, K’\ip']{ 1) = 0), so that by multiplication by ip(x) and integration with respect to 
V, 


ri[ipK[ip']\ = -X' 0 7][ip'ip]+ri(l)b 1 ip'(2)ip(l). 


Let us next check the second assertion of Theorem [H 
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Lemma 15 Under the entrance boundary condition, (ED is valid. 


Proof 

If we were working with an ergodic birth and death on Z + , this result is due to Mao m To come 
back to this situation, let us consider the Markov generator L on N which coincides with L, except 
that L(0,1) = 1 = — L(0,0). For this process, oo is still an entrance boundary. Let (A n ) ne z + be 
the eigenvalues of — L. We have Aq = 0 and Mao |13l has shown that 


nsN An 


< + 00 . 


It is well-known that the eigenvalues (A n )neZ+ and (A n ) ne z + are interlaced: 

Aq < Aq ^ Ai ^ Ai ■ ■ ■ 


(see for instance Miclo m where this kind of comparison was extensively used). This implies the 
validity of ED- 

■ 

We can now readily end the 

Proof of the bound of Theorem |4] 

For N e N, let (pjv be an eigenvector associated with the eigenvalue A/v,o of and normalized 
by 9?jv(l) = 1. According to Proposition 0 whose reversibility assumption is satisfied, we have 




< 


1 - 


Ajv,o 


A', 


Let Aq e N be large enough so that 

Atv 0 ,o < 

It follows that for N ^ Nq, 


MO/ fcgJTV—1] 

Ao + Aq A Ai 


n 


AjV,r; 


(> Aq). 


1 _ -^MO > _ 'W,0 


A', 


N, 0 


1 - 


% 

Aq + Aq 
2An 


Ap — Aq 
2A' ' 


In a similar manner, we get that for any n e N, 


1 - 


Ajy,c 

Aa+ 


^ 1 - 


Aq + Ai 

2 An 


so that for all N 5= Nq, 




< 


Aq ~ Aq 

2 An 


n > 


0 ' ke N 

which is finite because of Lemma IT4l and ED- 


Aq + Aj 
2 An 


-l 


(28) 
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The functions (pjy are also increasing on [iV — 1]. Consider them as non-decreasing mappings 
defined on N by taking tpN(n) = <pn(N) for all n ^ N. Due to this monotonicity property and to 
the above uniform bound on a VN over N ^ Nq, we can find an increasing subsequence (lV/); e pj and 
a non-decreasing and bounded function Ip on N with <J5(1) = 1 such that <pn 1 converge uniformly 
on N toward <p as l goes to infinity. We are then allowed to pass to the limit in the equation 
K N [<p N \ = -Ajv.o^at to get on N, 

K W\ = -Ao<£- 

Since the function <p is bounded, it also belongs to L 2 ( 77 ) and so it is an eigenvector associated to 
the eigenvalue —Ao of K. It must thus be proportional to ip. 

The previous considerations also enable to pass to the limit in (l28|) and this ends the proof of 
Theorem [T] 


Let us recall a classical 

Proof of Proposition [5] 

According to Karlin and McGregor {12] . the a.s. absorption of the processes X x , for x e N, is 
equivalent to 


y 


— +G0, 


and this divergence clearly implies that of (j4j). 

Similarly to the proof of Proposition [8], consider next the mapping / on R + x Z + defined by 
V (t, x) e R + x Z+, f(t,x ) := exp(A t)p(x) 

(as usual, we impose <£>(0) = 0). By the martingale problem solved by the law of X x , for x e N, 
the process M := given by 


0, M t := f(t,X?)~ 


/(0, x) - f d 8 f(s, X x ) + L[f(s, -)J(XJ) ds 

Jo 


is a local martingale and even a martingale, because for any fixed t ^ 0 , Mf is bounded, due to the 
assumption a v < Too. The stopped stochastic process (M tAT;i . 1 ) t ^ 0 is also a martingale, so taking 
expectations at time t ^ 0 , we get 

''t A Tx, 1 


E [f(t,X? ATxl )] = <p(x) + E 
= ip{x) + E 


I 


d s f(s,X*) + L[f(s,-)](X*)ds 


o 

f (A ip + L[ip])(X x ) exp(A s)ds 

Do 


By assumption, we have A ip + L[tp] ^ 0 on N, so that 

E [y^y*,i) ex P(A(i a r x ,i))] sc ip(x), 

and it follows that 

E[exp(A(f a t Xj i))] ^ a ^. 
Letting t go to infinity, we deduce that 

E[exp(Ar X; i)] - 1 


<: 


< 


A 


A ' 
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E[t Xj i] 








But it is well-known (see for instance Paragraph 8.1 of Anderson [2]) that 


- SjV i "• 

y=l n y°y z=y+l 


thus letting x go to infinity we obtain 


oo i 00 


Z VY 2 ^ < 

y=l n V U y z=y+1 


< + 00 , 


namely © is satisfied. This ends the proof that go is an entrance boundary for L. 


Finally, let us discuss the conditions (JU) and ({5]): 
Example 16 Consider the rates given for all n e Z + by 


b 

d 


n 


n 


1 , if n ^ 1 

0 , if n = 0 

n , if n > 1 
0 , if n = 0. 


The measure n defined in © is proportional to the restriction on N of the Poisson distribution of 
parameter 1: 

V n e N, n n = —. (29) 

n! 

It is easily computed that © is not satisfied. 

To transform oo into an entrance boundary, the underlying Markov process must be accelerated 
near oo: consider the rates given for all n e Z + by 


b 


n 


dn 


ln 2 (e + n) , if n > 1 
0 , if n = 0 

n ln 2 (e — 1 + n) , if n 5= 1 
0 , if n = 0. 


The measure n is not modified, still given by (|29j) . Nevertheless Conditions (0]) and © are satisfied 
and Theorem []] can be applied. 

□ 
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